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METHOD AND SYSTEM FOR SYSTEM PERFORMANCE OPTIMIZATION VIA 
HEURI S T I CALL Y OPTIMIZED BUSES 

RELATED APPLICATION 




This application is related^ to commonly assigned and 

co-pending U.S. Patent serial number No. 

(Attorney docket No. AT 9 9^1 08 entitled "Heuristic Bus 
Performance Optimization", filed on even date herewith 
10 and hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 



1. Technical Field: 

15 

The present invention relates to method and system 
for enhancing bus performance, and particularly, to 
system performance optimization using the processing 
capabilities of an operating system (OS) , as well as 
20 internal capabilities of adapters. 



2 . Description of Related Art : 



Currently, network computing is in wide use. The 
25 old form of a single, stand-alone computer system is no 
longer the only form of a computer system. Consequently, 
connectivity is one of the key system performance 
measures. This is especially true for server class 
systems. Network computing necessarily leads to a large 
30 number of communications in both inter-network and 
intra-network context. 
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Furthermore, a large number of mass storage 
adapters, which handle large amounts of rapid data flow, 
are also the result of network computing. These large 
numbers of mass storage adapters are not only dissimilar 
5 in their external protocol and unique design-based 

operating characteristics, but they also link a given 
system/server to dissimilar remote entities. In other 
words, the adapters have different types of hardware, and 
run on different applications. 

10 In addition, the matter is made more complicated by 

the introduction of non-trivial bus hierarchies such as 
Peripheral Component Interconnect (PCI), PCI-X, which is 
a PCI bus with even more parameters, or InfiniBand. 
InfiniBand is an association-developed specification for 

15 computer input/output architecture by InfiniBand Trade 
Association (IBTA) . In other words, the number of 
hardware parameters and input/output (I/O) slots per 
system increase constantly with each new model being 
introduced. 

20 As can be appreciated, network speed or bandwidth 

increase demands for greater speed across network 
connections. It becomes desirable to have a method and 
system for enhancing bus performance of a computer that 
is at the other end of the network connections. By way of 

25 example, a server with an internal bus coupled to a 
network needs to have a means to accommodate a great 
amount of data flow from a network. Therefore, a better 
means to accommodate the data flow, after the data flows 
into the adapter, is significant. Currently, one problem 

30 commonly encountered is when the adapter needs more 

bandwidth in order to be more efficient but is unable to 
get the additional bandwidth. This may be because a 
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related OS of a computer system cannot meet the 
requirement in that it either does not know more 
bandwidth is needed, the adapter is not equipped to 
convey the need, or the OS is not directly involved in 
5 meeting the need. 

Known methods of adjusting bandwidth, such as 
manually flipping a dual in-line package (DIP) switch, or 
pre-defined bandwidth assignment at an application or 
software level, are in use. However, the known methods 

10 are limited by the fact that they are all restricted to 
methods that are internal to the adapter, or at most a 
monitor coupled to a local bus with the local bus coupled 
to the adapter. Thus, it would be beneficial to have a 
method and system that use an operating system (OS) 

15 independent of the adapter, as well as use internal 
capabilities of adapters for system performance 
optimization . 
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SUMMARY OF THE INVENTION 



A method and system for enhancing performance of a 
bus in a data processing system is described. The method 
includes monitoring data flow through an adapter coupled 
to the bus in a data processing system, determining if 
increased bus performance is desirable; and handing off 
control to a code module which enhances the performance 
of the bus if increased bus performance is desirable. 

The code module for heuristic bus optimization 
includes a performance optimizer unit, a hardware bus 
control unit coupled to the performance optimizer unit, 
and a process management unit managing at least one 
device driver. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
5 invention are set forth in the appended claims. The 

invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
10 conjunction with the accompanying drawings, wherein: 
Figure 1 depicts a pictorial representation of a 
network of data processing systems in which the present 
invention may be implemented; 

Figure 2 depicts a data processing system that may 
15 be implemented as a server in which the present invention 
may be implemented; 

Figure 3 depicts a block diagram illustrating a data 
processing system is depicted in which the present 
invention may be implemented; 
20 Figure 4A depicts a block diagram of one embodiment 

of the invention, depicting both the hard ware layout and 
some software relationship within a control unit, in 
which the present invention may be implemented; 

Figure 4B depicts a block diagram of the invention 
25 described in Figure 4A, depicting software relationship 
within the control unit, in which the present invention 
may be implemented; 

Figure 5 depicts a flowchart illustrating an 
exemplary method for heuristically optimizing the 
30 performance of a bus; and 
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Figure 6 depicts a flowchart illustrating another 
exemplary method for heuristically optimizing the 
performance of a bus. 



7 

Docket No, AUS920010332US1 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With reference now to the figures, Figure 1 depicts a 
pictorial representation of a network of data processing 
5 systems in which the present invention may be implemented. 
Network data processing system 100 is a network of 
computers in which the present invention may be 
implemented. Network data processing system 100 contains 
a network 102, which is the medium used to provide 

10 communications links between various devices and computers 
connected together within network data processing system 
100. Network 102 may include connections, such as wire, 
wireless communication links, or fiber optic cables. 

In the depicted example, server 104 is connected to 

15 network 102 along with storage unit 106. In addition, 
clients 108, 110, and 112 are connected to network 102. 
These clients 108, 110, and 112 may be, for example, 
personal computers or network computers. In the depicted 
example, server 104 provides data, such as boot files, 

20 operating system images, and applications to clients 

108-112. Clients 108, 110, and 112 are clients to server 
104. Network data processing system 100 may include 
additional servers, clients, and other devices not shown. 
In the depicted example, network data processing system 

25 100 is the Internet with network 102 representing a 

worldwide collection of networks and gateways that use the 
TCP/IP suite of protocols to communicate with one another. 

At the heart of the Internet is a backbone of high-speed 
data communication lines between major nodes or host 

30 computers, consisting of thousands of commercial, 

government, educational and other computer systems that 
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route data and messages. Of course, network data 
processing system 100 also may be implemented as a number 
of different types of networks, such as for example, an 
intranet, a local area network (LAN) , or a wide area 
5 network (WAN) . Figure 1 is intended as an example, and not 
as an architectural limitation for the present invention. 

Referring to Figure 2, a block diagram of a data 
processing system that may be implemented as a server, 
such as server 104 in Figure 1, is depicted in accordance 

10 with a preferred embodiment of the present invention. 
Data processing system 200 may be a symmetric 
multiprocessor (SMP) system including a plurality of 
processors 202 and 204 connected to system bus 206. 
Alternatively, a single processor system may be employed. 

15 Also connected to system bus 206 is memory 

controller/cache 208, which provides an interface to local 
memory 209. I/O bus bridge 210 is connected to system bus 
206 and provides an interface to I/O bus 212. Memory 
controller/cache 208 and I/O bus bridge 210 may be 

20 integrated as depicted. 

Peripheral component interconnect (PCI) bus bridge 
214 connected to I/O bus 212 provides an interface to PCI 
local bus 216. A number of modems may be connected to PCI 
local bus 216. Typical PCI bus implementations will 

25 support four PCI expansion slots or add-in connectors. 

Communications links to clients 108-112 in Figure 1 may be 
provided through modem 218 and network adapter 220 
connected to PCI local bus 216 through add-in boards. 
Additional PCI bus bridges 222 and 224 provide 

30 interfaces for additional PCI local buses 226 and 228, 
from which additional modems or network adapters may be 
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supported. In this manner, data processing system 200 
allows connections to multiple network computers. A 
memory-mapped graphics adapter 230 and hard disk 232 may 
also be connected to I/O bus 212 as depicted, either 
5 directly or indirectly. 

Those of ordinary skill in the art will appreciate 
that the hardware depicted in Figure 2 may vary. For 
example, other peripheral devices, such as optical disk 
drives and the like, also may be used in addition to or in 
10 place of the hardware depicted. The depicted example is 
not meant to imply architectural limitations with respect 
to the present invention, 
yj The data processing system depicted in Figure 2 may 

be, for example, an IBM e-Server pSeries system, a 
15 product of International Business Machines Corporation in 
^ Armonk, New York, running the Advanced Interactive 

Pjj Executive (AIX) operating system or LINUX operating 

m system. 

0* With reference now to Figure 3, a block diagram 

jf 20 illustrating a data processing system is depicted in which 
P the present invention may be implemented. Data processing 

system 300 is an example of a client computer. Data 
processing system 300 employs a peripheral component 
interconnect (PCI) local bus architecture. Although the 
25 depicted example employs a PCI bus, other bus 

architectures such as Accelerated Graphics Port (AGP) and 
Industry Standard Architecture (ISA) may be used. 
Processor 302 and main memory 304 are connected to PCI 
local bus 306 through PCI bridge 308. PCI bridge 308 also 
30 may include an integrated memory controller and cache 

memory for processor 302. Additional connections to PCI 
local bus 306 may be made through direct component 
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interconnection or through add-in boards. In the depicted 
example, local area network (LAN) adapter 310, SCSI host 
bus adapter 312, and expansion bus interface 314 are 
connected to PCI local bus 306 by direct component 
5 connection. In contrast, audio adapter 316, graphics 

adapter 318, and audio/video adapter 319 are connected to 
PCI local bus 306 by add-in boards inserted into expansion 
slots. Expansion bus interface 314 provides a connection 
for a keyboard and mouse adapter 320, modem 322, and 

10 additional memory 324. Small computer system interface 

(SCSI) host bus adapter 312 provides a connection for hard 
disk drive 326, tape drive 328, and CD-ROM drive 330. 
Typical PCI local bus implementations will support three 
or four PCI expansion slots or add-in connectors. 

15 An operating system runs on processor 302 and is used 

to coordinate and provide control of various components 
within data processing system 300 in Figure 3. The 
operating system may be a commercially available operating 
system, such as Windows 2000, which is available from 

20 Microsoft Corporation. An object oriented programming 
system such as Java may run in conjunction with the 
operating system and provide calls to the operating system 
from Java programs or applications executing on data 
processing system 300. "Java" is a trademark of Sun 

25 Microsystems, Inc. Instructions for the operating system, 
the object-oriented operating system, and applications or 
programs are located on storage devices, such as hard disk 
drive 326, and may be loaded into main memory 304 for 
execution by processor . 302 . 



1 
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Those of ordinary skill in the art will appreciate 
that the hardware in Figure 3 may vary depending on the 
implementation. Other internal hardware or peripheral 
devices, such as flash ROM (or equivalent nonvolatile 
5 memory) or optical disk drives and the like, may be used 
in addition to or in place of the hardware depicted in 
Figure 3. Also, the processes of the present invention 
may be applied to a multiprocessor data processing 
system. 

10 As another example, data processing system 300 may 

be a stand-alone system configured to be bootable without 
relying on some type of network communication interface, 
whether or not data processing system 300 comprises some 
type of network communication interface. As a further 

15 example, data processing system 300 may be a Personal 

Digital Assistant (PDA) device, which is configured with 
ROM and/or flash ROM in order to provide non-volatile 
memory for storing operating system files and/or 
user-generated data. 

20 The depicted example in Figure 3 and above-described 

examples are not meant to imply architectural 
limitations. For example, data processing system 300 
also may be a notebook computer or hand held computer in 
addition to taking the form of a PDA. Data processing 

25 system 300 also may be a kiosk or a Web appliance. 

Referring now to Figure 4A, a block diagram of one 
embodiment of the invention, depicting both the hardware 
layout and some software relationship within a control 
unit, is described. A set of central processing unites 

30 (CPU) 402, also known as Multiple CPUs, wherein each CPU 
is dynamically coupled with other CPUs such that its 
internal processing structures can be considered as a 
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whole. Multiple CPUs 402 includes applications 404 which 
may be a set of code structure or software at an 
application level. Multiple CPUs 402 further includes an 
operating system (OS) Kernel Code 406. Multiple CPUs 402 
5 is coupled to a system bus 408. 

Turning back to the operating system (OS) Kernel 
Code 406 , it comprises a set of computer instruction for 
optimizing overall bus performance heuristically . In 
other words, operating system (OS) Kernel Code 406 
10 enables a learning process whereby a bus system learns 
from past acts or events thereby optimizing bus 
f§ performance. In addition, this heuristic process can be 

considered as a feedback process, which will be described 
m infra. A process management 410 instructions, wherein a 

rfB 15 priority in regard to various devices, is logically 
m coupled to a set of device drivers including device 

§ijJ driver #1 416, device driver #2 418, and device driver #n 

p 420. The device drivers in turn control their respective 

inni 

devices through various means including control through a 
20 set of bus parameters. A performance optimizer is 
rT logically coupled to process management 410 and hardware 

bus control unit 414 that controls the bus via a set of 
bus parameters. 

A memory 422 couples to the system bus 408. An I/O 
25 bus hub 424 is coupled to the system bus 408 as well. 
I/O bus hub 424 also includes a bus monitor 425 that 
monitors buses. The buses that bus monitor 425 monitors 
includes system bus 408 as well as other bus described 
infra. I/O bus 426 couples I/O bus hub 424 and a set of 
30 I/O adapters together. The set of I/O adapters comprises 
I/O adapter #1 428, I/O adapter #2 430, and I/O adapter 
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#n 432 each having a one-on-one relationship with device 
driver #1 416, device driver #2 418, and device driver #n 
420 respectively. 

As can be appreciated, the block diagram of Figure 
5 4A can either be applied to Figure 2 or Figure 3. In 
other words, the content of Figure 4A is applicable to 
both server and client environments. Furthermore, each 
of the adapters, I/O adapter #1 428, I/O adapter #2 430, 
and I/O adapter #n 432, can be coupled to an outside high 
10 speed network (not shown) or another data processing 

system (not shown either) from time to time whereby bus 
rg optimization is definitely required. 

Turning now to Figure 4B, a block diagram of the one 
embodiment of the invention described in Figure 4A, 
\I 15 depicting software relationship within the control unit, 
nil is described. As in Figure 4A, operating system (OS) 

*J* Kernel Code 406 comprises a set of computer instruction 

0 for optimizing overall bus performance heuristically . In 

|\ other words, operating system (OS) Kernel Code 406 

Hp 20 enables a learning process whereby a bus system learns 
y. from past acts or events thereby optimizing bus 

performance. In addition, this heuristic process can be 
considered as a feedback process, which will be described 
infra. A process management 410 instructions, wherein a 
25 priority in regard to various devices, is logically 
coupled to a set of device drivers including device 
driver #1 416, device driver #2 418, and device driver #n 
420. The device drivers in turn control their respective 
devices through various means including control through a 
30 set of bus parameters. A performance optimizer is 

logically coupled to process management 410 and hardware 
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bus control unit 414 that controls bus via a set of bus 
parameters . 

In addition to the description in Figure 4A, each 
device driver, including device driver #1 416, device 
5 driver #2 418, and device driver #n 420, is logically 
coupled to a specific adapter among various adapters. 
The adapters can be I/O adapter #1 428, I/O adapter #2 
430, and I/O adapter #n 432. In this way, the device 
driver controls I/O adapter through various bus 
10 parameters. The performance optimizer 412, by way of 

hardware bus control 414, is logically coupled to the I/O 
p bus hub 424. Hardware bus control 414 further controls 

sj% various bus parameters residing in I/O bus hub 424. 

00 Referring now to Figure 5, a flowchart 500 depicting 

yg 15 a heuristic bus optimization is described. A process 

management queue is scanned by the performance optimizer 
- 412 (step 502) . A determination is made by performance 

Jjf optimizer 412 (step 504) as to whether the process 

hk management queue includes at least one high priority I/O 

J* 20 process. For example, the high priority I/O process can 
M= be an increase in input through an adapter among various 

adapters, or a large graphic file waiting to be printed. 
If there is no high priority I/O process in the queue, 
the logic flow leads back to step 502 wherein further 
25 scan is done for high priority I/O process. If there is 
a high priority I/O process, performance optimizer 412 
queries hardware bus control 414 for bus performance of 
relevant I/O devices (step 506) . For example, the 
relevant I/O devices can be any that are sharing an 
30 information flow channel with the high priority I/O 
process . 
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Hardware bus control 414 reads bus performance (step 
508) . The bus performance includes a set of values of 
various bus parameters. A determination is made (step 
510) as to whether bus performance is optimized for the 
5 most critical I/O process. If the answer is yes, the 
logic flow leads back to step 502. If the answer is no, 
performance optimizer 412 passes new parameters to at 
least one device driver, including device driver #1 416, 
device driver #2 418, and device driver #n 420, changes 
10 some bus parameters in at least one I/O adapter, 

including I/O adapter #1 428, I/O adapter #2 430, and I/O 
□ adapter #n 432 (step 514) . The flowchart 500 flows back, 

2j or feedback toward step 502 thereby a feedback loop is 

03 complete. In other words, the heuristic bus optimization 

\ a 15 process is a continuous process wherein an optimization 
nfi point is optimized in a continuous basis, or at least at 

^ a predetermined set of points. 

C3 As an alternative, the optimization can be done on a 

periodical basis such that optimization is done at the 

20 end a fixed segment of time. 
Zl Referring now to Figure 6, a flowchart 600 depicting 

a similar heuristic bus optimization is described. A 
process management queue is scanned by the performance 
optimizer 412 (step 602) . A determination is made by 

25 performance optimizer 412 at step 604 as to whether the 
process management queue includes at least one high 
priority I/O process. For example, the high priority I/O 
process can be an increase in input through an adapter 
among various adapters, or a large graphic file waiting 

30 to be printed. If there is no high priority I/O process 
in the queue, the logic flow leads back to step 602 
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wherein further scan is done for high priority I/O 
process. If there is a high priority I/O process, 
performance optimizer 412 queries hardware bus control 
414 for bus performance of relevant I/O devices (step 
5 607) . For example, the relevant I/O devices can be any 
are sharing an information flow channel with the high 
priority I/O process. 

Hardware bus control 414 reads bus performance (step 
608) . The bus performance includes a set of values of 
10 various bus parameters. A determination is made at step 
610 as to whether bus performance is optimized for the 
fsi most critical I/O process. If the answer is yes, the 

'fl logic flow leads back to step 602. If the answer is no, 

m performance optimizer 412 passes new parameters to 

15 hardware bus control 414, as well as passes new 
n|J parameters to at least one device driver via process 

^ management 410 (step 612) . 

C3 At this juncture, bus parameters in the I/O bus hub 

424 are changed through instructions issued by the 
5= 20 hardware bus control 414 (step 617) . In addition, at 
£|l least one device driver, including device driver #1 416, 

device driver #2 418, and device driver #n 420, changes 
some bus parameters in at least one I/O adapter, 
including I/O adapter #1 428, I/O adapter #2 430, and I/O 
25 adapter #n 432 (step 514) . The flowchart 600 flows back, 
or feedback toward step 602 thereby a feedback loop is 
complete. In other words, the heuristic bus optimization 
process is a continuous process wherein an optimization 
point is optimized in a continuous basis, or at least at 
30 a predetermined set of points. 
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As an alternative, the optimization can be done on a 
periodical basis such that optimization is done at the 
end a fixed segment of time. 

In addition to the process listed above, an 
5 operating system priority process normally residing in 
process management 410, is operating in parallel that 
reorders the Process Management queue so that high 
priority I/O processes move to the top, thus designating 
a priority as to which adapter has the right to be ranked 

10 above others. Along with the process priorities 

contained within Process Management 410, within the 
Performance Optimizer 412, a system specific portion of 
bandwidth is made variable and is assigned between 
adapters based upon the priority registered with the OS 

15 by their device drivers. As a result, required 

adjustments relating to bandwidth are determined each 
time the priority changes. In addition, the adjustments 
can be done on a periodic basis. That is to say, the 
adjustments are done after a predetermined time segment. 

20 As can be appreciated, the above are higher level, or 
software related actions. After the above actions or, 
more specifically adjustments, are done, relevant 
hardware actions are needed. In other words, hardware is 
being driven such that specific adapters or adapter are 

25 given more bandwidth. Thus, this invention represents a 
synergy between software and hardware. In other words, a 
dynamic overlap exists between software and hardware 
domains . 

The above flowcharts 500 and 600 can be better 
30 explained by way of an example. For instance, an 
application is driving I/O transactions through an 
Ethernet I/O device to service a user's application. The 



18 

Docket No. AUS920010332US1 

user determines that this application is the most ^/ ^J^/il 
critical on the system and boosts the priority of the ^{-^^ 
application, indirectly boosting the priority of the 
application's processes including any processes that 
5 issue I/O through the Ethernet adapter. At this point, 
the application issues an I/O process which becomes high 
priority based on the previous actions. While the 
performance optimizer is scanning all running 
applications, it is determined that there is a high 

10 priority Ethernet I/O that can be assisted by boosting 

bus performance. In turn, the Performance Optimizer 412 
changes hardware settings for the buses and bridges 
upstream of that adapter in small steps, or incremental 
ranges, along the direction that is dictated by the 

15 Performance Optimizer, until the optimal performance 

point is reached. Later, as the system load/application 
changes, bus or buses can be optimized again or 
re-optimized. In fact, this optimization process is 
dynamic and continuous. It is conceptually analogous to 

20 a feedback control principle in that the system 

dynamically adjusts itself until an optimal state is 
achieved. 

It is noted that parameters or bus performance 
factors include arbitration scheme, latency timers, etc. 

25 As can be appreciated, the net goal of any bus 

performance optimization is to maximize the overall 
system performance. The need to have such a system of 
heuristic optimization grows as we move from PCI to 
PCI-X, and then on to InfiniBand. In these environments, 

30 additional levers are provided to tune the system, but an 
automated method is needed to optimize or "squeeze out" 
system performance that is normally lost and also to keep 
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the system at its optimum performance level for any 
system configuration or application. In a network 
computing environment performance of I/O subsystem 
becomes as important as the performance of a central 
5 processing unit (CPU) . This is especially true for a 
server such as the one depicted in Figure 2. 

It is important to note that while the present 
invention has been described in the context of a fully 
functioning data processing system, those of ordinary 
10 skill in the art will appreciate that the processes of 

the present invention are capable of being distributed in 
the form of a computer readable medium of instructions 
.q and a variety of forms and that the present invention 

00 applies equally regardless of the particular type of 

£T 15 signal bearing media actually used to carry out the 
j=v distribution. Examples of computer readable media 

"n|J include recordable-type media, such as a floppy disk, a 

hard disk drive, a RAM, CD-ROMs, DVD-ROMs, and 
f£ transmission-type media, such as digital and analog 

20 communications links, wired or wireless communications 
fg links using transmission forms, such as, for example, 

^ radio frequency and light wave transmissions. The 

computer readable media may take the form of coded 
formats that are decoded for actual use in a particular 
25 data processing system. 

The description of the present invention has been 
presented for purposes of illustration and description, 
and is not intended to be exhaustive or limited to the 
invention in the form disclosed. Many modifications and 
30 variations will be apparent to those of ordinary skill in 
the art. The embodiment was chosen and described in 
order to best explain the principles of the invention, 
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the practical application, and to enable others of 
ordinary skill in the art to understand the invention 
various embodiments with various modifications as are 
suited to the particular use contemplated. 



